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CROSS REFERENCE TO RELATED APPLICATIONS 

The present application claims benefit of U.S. Provisional Patent 
Application No. 60/484,282 filed on July 2, 2003, entitled "Gear-on" listing the 
same inventors, the disclosure of which is hereby incorporated by reference. 

10 

FIELD OF THE INVENTION 

The present invention relates generally to capturing content and, more 
particularly, to capturing and viewing content through a multi-lens device. 

15 BACKGROUND 

There are many personal video cameras in use. With the increase in 
quality of personal video cameras and decrease in cost and size of these 
cameras, it is getting easier and cheaper for individuals to capture high quality 
video footage of events detailing their lives. For example, many users capture 

20 traditional events such as vacations, birthdays, and weddings with their video 
cameras. With the increase in portability of modern personal video cameras, 
users are also capturing video footage of their hobbies that reflect their active 
lifestyles such as skiing, mountain climbing, mountain biking, kayaking, sky- 
diving, and the like. 

25 With the increase in use of personal video cameras, there is an increasing 
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amount of video footage recorded by users. Although potentially more video 
footage is captured, the amount of time and desire dedicated to spend viewing 
the captured video footage does not necessarily increase. Accordingly, there is 
an increasing demand to improve the quality of the captured video footage. 
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SUMMARY 

In one embodiment, the methods and apparatuses simultaneously display 
5 a first content stream and a second content stream within a spherical display; 
receive instructions to change a partition between a first area for displaying the 
first content stream and a second area for displaying the second content stream; 
and dynamically partition the first area and the second area based on the 
instructions, wherein the first area and the second area are within the spherical 
10 display. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The accompanying drawings, which are incorporated in and constitute a 
part of this specification, illustrate and explain one embodiment of the methods 
5 and apparatuses for capturing and viewing content through a multi-lens device. 
In the drawings, 

Figure 1 is a diagram illustrating an environment within which the methods 
and apparatuses for capturing and viewing content through a multi-lens device 
are implemented; 

10 Figure 2 is a simplified block diagram illustrating one embodiment in which 

the methods and apparatuses for capturing and viewing content through a multi- 
lens device are implemented; 

Figure 3 is a simplified block diagram illustrating a system, consistent with 
one embodiment of the methods and apparatuses for capturing and viewing 
15 content through a multi-lens device; 

Figure 4 is an exemplary record consistent with one embodiment of the 
methods and apparatuses for capturing and viewing content through a multi-lens 
device; 

Figure 5 is a diagram illustrating an exemplary embodiment within which 
20 the methods and apparatuses for capturing and viewing content through a multi- 
lens device are implemented; 
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Figure 6A and 6B are diagrams illustrating an environment within which 
the methods and apparatuses for capturing and viewing content through a multi- 
lens device are implemented; 

Figures 7A, 7B, 7C and 7D are exemplary screen shots consistent with 
5 one embodiment of the methods and apparatuses for capturing and viewing 
content through a multi-lens device; 

Figure 8A, 8B, 8C are exemplary screen shots consistent with one 
embodiment of the methods and apparatuses for capturing and viewing content 
through a multi-lens device; and 
10 Figure 9 is a diagram illustrating an environment within which the methods 

and apparatuses for capturing and viewing content through a multi-lens device 
are implemented. 



15 
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DETAILED DESCRIPTION 

The following detailed description of the methods and apparatuses for 
capturing and viewing content through a multi-lens device refers to the 
5 accompanying drawings. The detailed description is not intended to limit the 
methods and apparatuses for capturing and viewing content through a multi-lens 
device. Instead, the scope of the methods and apparatuses for capturing and 
viewing content through a multi-lens device are defined by the appended claims 
and equivalents. Those skilled in the art will recognize that many other 
10 implementations are possible, consistent with the present invention. 

References to "content" includes textual data, graphical data, video 
footage, digital images, audio data, and the like. 

In one embodiment, the methods and apparatuses for capturing and 
viewing content through a multi-lens device allow content to be captured 
15 simultaneously through multiple lenses, simultaneously display multiple content 
feeds to a viewer, manage multiple feeds of content through a unified interface. 

Figure 1 is a diagram illustrating an environment within which the methods 
and apparatuses for capturing and viewing content through a multi-lens device 
are implemented. The environment includes an electronic device 110 (e.g., a 
20 digital camera, a video camera, a display device, and a projector for displaying 
content), a user interface 1 15, a network 120 (e.g., a local area network, a home 
network, the Internet), and a server 130 (e.g., a computing platform configured to 
act as a server). 
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In one embodiment, one or more user interface 115 components are 
made integral with the electronic device 110 (e.g., keypad and video display 
screen input and output interfaces such as a display and speakers in the same 
housing. In one embodiment, the user utilizes interface 115 to access and 
5 control content and applications stored in electronic device 110, server 130, or a 
remote storage device (not shown) coupled via network 120. 

In accordance with the invention, embodiments of capturing and viewing 
content through a multi-lens device below are executed by an electronic 
processor in electronic device 1 10, in server 130, or by processors in electronic 
10 device 110 and in server 130 acting together. Server 130 is illustrated in Figure 
1 as being a single computing platform, but in other instances are two or more 
interconnected computing platforms that act as a server. 

In one embodiment, the electronic device 1 10 is a content capturing 
device such as a digital camera, a video camera, and an audio recorder. The 
15 content capturing device is utilized to capture content. In another embodiment, 
the electronic device 1 10 is a display device such as a screen, a monitor, a 
projector, and the like. The display device is utilized to display the content to at 
least one viewer. 

Figure 2 is a simplified diagram illustrating an exemplary architecture in 
20 which the methods and apparatuses for capturing and viewing content through a 
multi-lens device are implemented. 

The exemplary architecture includes a plurality of electronic devices 110, 
a server device 130, and a network 120 connecting electronic devices 1 10 to 
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server 130 and each electronic device 1 10 to each other. The plurality of 
electronic devices 1 10 are each configured to include a computer-readable 
medium 209, such as random access memory, coupled to an electronic 
processor 208. Processor 208 executes program instructions stored in the 
computer-readable medium 209. In one embodiment, a unique user operates 
each electronic device 1 10 via an interface 1 15 as described with reference to 
Figure 1 . 

The server device 130 includes a processor 21 1 coupled to a computer- 
readable medium 212. In one embodiment, the server device 130 is coupled to 
one or more additional external or internal devices, such as, without limitation, a 
secondary data storage element, such as database 240. 

In one embodiment, the plurality of client devices 110 and the server 130 
include instructions for a customized application for capturing and viewing 
content through a multi-lens device. In one embodiment, the plurality of 
computer-readable media 209 and 212 contain, in part, the customized 
application. Additionally, the plurality of client devices 110 and the server 130 
are configured to receive and transmit electronic messages for use with the 
customized application. Similarly, the network 120 is configured to transmit 
electronic messages for use with the customized application. 

One or more user applications are stored in media 209, in media 212, or a 
single user application is stored in part in one media 209 and in part in media 
212. In one instance, a stored user application, regardless of storage location, is 
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made customizable based on capturing and viewing content through a multi-lens 
device as determined using embodiments described below. 

Figure 3 illustrates one embodiment of a system 300. In one embodiment, 
the system 300 is embodied within the server 130. In another embodiment, the 
5 system 300 is embodied within the electronic device 110. In yet another 

embodiment, the system 300 is embodied within both the electronic device 110 
and the server 130. 

In one embodiment, the system 300 includes a rendering module 310, a 
content capture module 320, a storage module 330, an interface module 340, a 
10 control module 350, and a content detection module 360. 

In one embodiment, the control module 350 communicates with the 
rendering module 310, the content capture module 320, the storage module 330, 
the interface module 340, and the content detection module 360. In one 
embodiment, the control module 350 coordinates tasks, requests, and 
15 communications between the rendering module 310, the content capture module 
320, the storage module 330, the interface module 340, and the content 
detection module 360. 

In one embodiment, the rendering module 310 produces signals that 
present content to a viewer. In one embodiment, the signals represent content 
20 such as audio data, image data, and a combination of audio/video data. 

In one embodiment, the content capture module 320 identifies the content 
that is being captured. In one embodiment, the content capture module 320 
organizes content that is captured simultaneously through multiple lenses. For 
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example, a video camera having multiple lenses is capable of capturing multiple 
unique scenes simultaneously. The content capture module 320 manages 
capturing those multiple unique scenes. Further, the content capture module 320 
also coordinates the display of the content. 
5 In one embodiment, the storage module 330 stores the content organized 

by the content capture module 320. 

In another embodiment, the storage module 330 stores a record including 
information associated with a particular piece of content. An exemplary 
embodiment of the information contained within the record associated with the 
10 content is illustrated in Figure 4. 

In one embodiment, the interface module 340 receives a signal from one 
of the electronic devices 110 transmitting the content to the system 300. In this 
embodiment, the electronic device 1 10 is either a content capturing device or a 
content storage device. 
15 In another embodiment, the interface module 340 transmits rendering 

information from the rendering module 310 to present the content to a viewer. 

In yet another embodiment, the interface module 340 transmits rendering 
information from the rendering module 310 to an external display device such as 
a projector, a separate display screen, and the like. The external display is 
20 configured to be seen by the viewer. 

In one embodiment, the content detection module 360 monitors the 
capture of the content. In one embodiment, the content includes multiple images 
captured simultaneously. For example, the content detection module 360 
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records the location of each source device. In one embodiment, the location of 
the source device is attached to the corresponding piece of content as metadata 
and is shown as a profile information in Figure 4. 

The system 300 in Figure 3 is shown for exemplary purposes and is 
5 merely one embodiment of the methods and apparatuses for capturing and 
viewing content through a multi-lens device. Additional modules may be added 
to the system 400 without departing from the scope of the methods and 
apparatuses for capturing and viewing content through a multi-lens device. 
Similarly, modules may be combined or deleted without departing from the scope 
10 of the methods and apparatuses for capturing and viewing content through a 
multi-lens device. 

Figure 4 illustrates an exemplary record 400 identifying profile information 
corresponding to a particular piece of content for use with the methods and 
apparatuses for capturing and viewing content through a multi-lens device. In 

15 one embodiment, there are multiple records such that each record 400 is 

associated with a particular piece of content. In one embodiment, the record 400 
is stored as metadata for the corresponding content. In one embodiment, the 
record 400 includes a unique identifier field 410, a content type field 420, a 
content source field 430, and a content listing field 440. 

20 In one embodiment, the unique identifier field 410 uniquely identifies the 

content. In one example, a descriptive name is utilized to identify the content 
such as Uncle Bob's 50 th Birthday. 

In one embodiment, the content type field 420 identifies the type of 
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content associated with the particular content. For example, exemplary content 
types include video, audio, image, and the like. 

In one embodiment, the content source field 430 identifies the origin of the 
content. In one embodiment, the origin of the content refers to the particular 
5 capture device that captured the content. In another embodiment, the origin of 
the content also refers to the specific lens that captured the content when there 
are multiple lenses on the same capture device. For example, both the video 
camera and the particular lens that captured the content is identified in the 
content source field 430. 
10 In one embodiment, the content listing field 440 identifies related content. 

For example, if the same capture device captures different video footage through 
different lenses, then the content listing field 440 references these related video 
footage. 

Figure 5 illustrates one embodiment of a camera 500 for capturing and 
15 displaying content through a multi-lens system. The camera 500 includes a main 
housing 505, a first capture module 510, and a second capture module 515. In 
one embodiment, the camera 500 is represented as the electronic device 110. 

In one embodiment, the main housing 505 includes a spherical display 
520, a control knob 525, and a playback ring 530. In one embodiment, the 
20 spherical display 520 is configured to simultaneously display video/image content 
and functional menu driven content. In another embodiment, the spherical 
display 520 is configured to simultaneously display multiple video feeds. 

In one embodiment, the control knob 525 adjusts and controls the content 
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and menu of the spherical display 520 in a vertical direction based on the 
direction that the knob 525 is turned. 

In one embodiment, the playback ring 530 rotates in both directions. In 
one embodiment, the playback ring 530 is utilized to control the direction (e.g. 
backwards, forward) and the speed of playing back the content such as video 
footage based on the rotation of the playback ring 530. In another embodiment, 
the playback ring 530 adjusts and controls the display of the content and menu 
on the spherical display 520 by rotating the objects in the display 520 
corresponding to a direction of the playback ring 530. 

In one embodiment, the first capture module 510 includes a lens module 
540 that is configured to capture visual content such as still images and video 
footage. In one embodiment, the first capture module 510 is removably coupled 
to the main housing 505. The first capture module 510 communicates with the 
main housing 505 via a wireless connection or a direct connection. In another 
embodiment, the first capture module 510 is permanently connected to the main 
housing 505. 

In one embodiment, the second capture module 515 includes a lens 
module 535 that is configured to capture visual content such as still images and 
video footage. In one embodiment, the second capture module 51 5 is removably 
coupled to the main housing 505. In another embodiment, the second capture 
module 515 is permanently connected to the main housing 505. 

The second capture module 515 communicates with the main housing 505 
via a wireless connection or a direct connection. In one embodiment, the first 
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and second capture modules 510 and 51 5 stream the visual content to the main 
housing 505 in real time via a wireless connection regardless of whether the 
capture modules 510 and 515 are physically connected with the main housing 
505. In another embodiment, the capture module 510 and 515 store the 
5 captured content and transmit the captured content to the main housing 505 in 
segments. 

In one embodiment, the capture modules 510 and 515 capture content at 
the same time. However, the captured content performed by the capture 
modules 510 and 515 are not the same and reflect a different view point or 
10 perspective of the corresponding capture module. 

The capture modules 510 and 515 are shown for illustrative purposes and 
any number of capture modules may be utilized with the main housing 505. 

In one embodiment, the capture modules 510 and 515 and the spherical 
display 520 enable a recording environment without a horizon. When capturing 
15 images of underwater sports, mid-air stunts, skydiving jumps, and the like, 
maintaining a proper orientation is difficult. 

In one embodiment, the capture modules 510 and 515 further include a 
sensor to detect the gravitation force such that the capture modules 510 and 515 
detects the direction towards the ground regardless of the orientation of the 
20 capture modules 510 and 515. In one embodiment, the sensor is a gyroscope. 
In another embodiment, the sensor is a mercury switch. 

In one embodiment, the spherical display 520 maintains a perpendicular 
orientation to the gravitation force such that the images captured by the capture 
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modules 510 and 515 and displayed on the spherical display 520 maintain the 
proper orientation even if the horizon is not part of the captured images. For 
example, the capture modules 510 and 515 continue to capture images and 
follow the subject regardless of the orientation of the capture modules 510 and 
5 515 with respect to the horizon. 

Figure 6A illustrates a front view of the spherical display 520 in greater 
detail. The spherical display 520 includes a playback ring 530, a playback head 
605, a current function display 610, and a display area 615. 

In one embodiment, the playback head 605 shows a graphical reference 

10 point of the current content that is being displayed on the spherical display 520. 
For example, instead of using a traditional time counter to track the current 
playback location of the content, the location of the playback head 605 illustrates 
the current playback location of the content, which portion of the content has 
already been viewed, and the portion of content that will be viewed. In one 

15 embodiment, as the content is played, the playback head 605 moves in a clock- 
wise direction. 

In one embodiment, the current function display 610 illustrates the current 
function of the spherical display 520. In one embodiment, the current function 
includes playbackof content, capture of content, and the like. 
20 In one embodiment, the display area 61 5 displays the content and menu 

information to a viewer. The menu information allows the viewer to select 
particular content and select specific functions such as playback content and 
capture content. In one embodiment, the display area 615 is curved to display 
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the content in a three dimensional manner. Further, the display area 615 also 
displays the menu information. In yet another embodiment, the content and the 
menu information are simultaneously displayed on the display area 615. 

Figure 6B illustrates a side view of the spherical display 520 in greater 
5 detail. The spherical display 520 includes a display area 615. The display area 
615 includes a spherical display surface 625 and a flat display surface 620. In 
one embodiment, the spherical display surface 625 is a three dimensional display 
surface and is utilized to display either the content or the menu information. In 
one embodiment, the flat display surface 620 is a two dimensional display 

10 surface and is utilized to display either the content or the menu information. 

In one embodiment, the content is displayed on the spherical display 
surface 625, and the menu information is displayed on the flat display surface 
620. In another embodiment, the menu information is displayed on the spherical 
display surface 625, and the content is displayed on the flat display surface 620. 

15 By displaying the menu information and the content on different display surfaces 
(e.g. the spherical display surface 625 and the flat display surface 620), the 
menu information and the content are displayed simultaneously and legibly to the 
viewer. By displaying the menu information and the content simultaneously, 
there is no need to choose between exclusively viewing the content and the 

20 menu information. 

Figure 7A illustrates the spherical display 520 in the context of content 
shown within the display area 615. The display area 615 is shown with content 
01 , content 02, and content 03. Each of the content 01 , 02, and 03 represent a 
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different video footage from a particular lens. In one embodiment, the content 

01 , 02, and 03 are recorded at the same time from different lenses. In another 
embodiment, the content 01 , 02, and 03 originate from the same lens and are 
captured at different times. 

5 In one embodiment, a dividing demarcation 750 is shown dividing the 

content 01, 02, and 03. In one embodiment, the playback ring 530 in 
combination with the knob 525 controls the allocation of the display area 615 
between the content 01 , 02, and 03. For example, by rotating the knob 525, the 
overall orientation of the content 01 , 02, and 03 is rotated. In this example, by 
10 rotating the playback ring 530, the amount of space allocated for the content 01 , 

02, and 03 is changed. In another example, by rotating the playback ring 530, 
the overall orientation of the content 01 , 02, and 03 is rotated. In this example, 
by rotating the knob 525, the amount of space allocated for the content 01 , 02, 
and 03 is changed. 

15 In another embodiment, instead of the areas of the content 01 , 02, and 03 

representing different content, each of the areas of the content 01, 02, and 03 
represent different special effects that are applied to different portions of the 
underlying content. The underlying content occupies the entire display area 615. 
Special effects include sepia tone, black and white tone, slow shutter effect, and 

20 the like. These special effects can be rendered in real-time. For example, the 
black and white tone is applied only to the content 01 and content 02 and 03 are 
left unaffected. In yet another embodiment, multiple layers of special effects are 
applied to the underlying content. 
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Figure 7B illustrates the spherical display 520 in the context of content 
shown within the display area 615. The display area 615 is shown with content 
01 , content 02, and content 03. The allocation of the display area 61 5 for the 
content 01 , content 02, and content 03 are changed from the content 01 . content 
5 02, and content 03 shown in Figure 7A. In Figure 7B, a greater area of the 
display area 615 is allocated for the content 01 , and content 03 compared to 
Figure 7A. 

Figure 7C illustrates the spherical display 520 in the context of content 
shown within the display area 615. The spherical display 520 includes the knob 

10 525, the playback ring 530, the playback head 605, and the current display 

function 610. In this example, the display area 615 is displaying a single content. 
In one embodiment, the content within the display area 61 5 is shown on the flat 
display surface 620. Further, the current display function 610 shows that the 
content displayed on the display area 615 is from "storage". 

15 Figure 7D illustrates the spherical display 520 in the context of content 

shown within the display area 615. The spherical display 520 includes the knob 
525, the playback ring 530, and the current display function 610. In this example, 
the display area 615 is displaying a multiple menu items 705. In one 
embodiment, the multiple menu items 705 within the display area 615 are shown 

20 on the spherical display surface 625. In another embodiment, content such as 
video footage is displayed simultaneously with the menu items 705. The content 
is displayed on the flat display surface 620 to differentiate the menu items 705 
from the content. 
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Further, the current display function 610 shows that the menu items 705 
on the display area 615 are from "menu". In this embodiment, the knob 525 is 
utilized to scroll through the menu items 705. 

Figure 8A illustrates the spherical display 520 in the context of content 
5 shown within the display area 615. The spherical display 520 includes the 
playback ring 530, the playback head 605, and the current display function 610. 
In one embodiment, the display area 615 allows a subject 810 within the display 
area 615 to be enlarged. The current display function 610 is shown in the "focus" 
mode. 

10 In one embodiment, the display area 61 5 includes a focus ring 805 and 

the subject 810. In one embodiment, the focus ring 805 is movable within the 
display area 615 and displays content within an area of the focus ring 805 that is 
to be enlarged. For example, if it is desired to enlarge the subject 810 that is 
shown within the display area 615, the focus ring 805 is moved such that the 

15 focus ring 805 encompasses the subject 810. In one embodiment, the playback 
ring 530 is utilized to move the focus ring 805. 

In another embodiment, the cursor keys 830 are utilized to position the 
focus ring 805 within the display area 615. The focus ring 805 is utilized to 
enlarge or shrink the focus ring 805 depending on the direction that the focus ring 

20 805 is rotated. 

Figure 8B illustrates the spherical display 520 in the context of content 
shown within the display area 615. The focus ring 805 is shown encompassing 
the subject 810 within the display area 615. 



PATENT 
SONY-06801 

Figure 8C illustrates the spherical display 520 in the context of content 
shown within the display area 615. The subject 810 is shown enlarged within the 
display area 615 relative to the subject 810 in Figures 8A and 8B. The focus ring 
805 is shown encompassing the subject 810 within the display area 615. 
5 In one embodiment, the enlargement process is accomplished by 

capturing a much wider perspective with a wide angle lens such as a fish eye 
lens as shown in Figure 8A. When an enlargement is desired, the area within the 
focus ring 805 is enlarged, and the content of the surrounding areas outside the 
focus ring 805 are ignored. However, the content of the surrounding areas 

10 outside the focus ring 805 are continually captured even if they are not shown 
within the display area 61 5 of Figure 8C. For example, regardless of the 
enlargement that is requested via the focus ring 805, the entire wide angle 
perspective as shown in Figure 8A is still being captured. 

Figures 8A, 8B, and 8C utilize the display head 605 to visually display the 

15 which portion of the content is being displayed within the display area 615. In 
one embodiment, the video segment (content) advances forward as the display 
head 605 rotates counter-clockwise. For example, the content within the display 
area 61 5 in Figure 8A is shown prior to the content within the display area 61 5 in 
Figure 8B. Further, the content within the display area 615 in Figure 8B is shown 

20 prior to the content within the display area 61 5 in Figure 8C. 

Figure 9 illustrates a system 900 for displaying content. In one 
embodiment, projector 905, projector 910, and projector 915 receive content from 
a capture device 920 such as a digital camera, a video camera, and the like. The 
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projectors 905, 910, and 915 are portable and configured to display content by 
projecting the content onto a surface. In one embodiment, each of the projectors 
905, 910, and 915 is associated with unique content. For example, each of the 
projectors 905, 910, and 915 is associated with a unique lens which transmits a 
5 different video feed. 

In use, the capture device 920 transmits content to the projectors 905, 
910, and 915. In one embodiment, the projectors 905, 910, and 915 are focused 
in a particular direction and show the associated content with the particular 
projector. In one embodiment, each of the projectors 905, 910, and 915 is aimed 

10 in an exclusive area to display their associated content without interference or 
overlap of other content. In another embodiment, some of the projectors 905, 
910, and 915 are aimed to overlap each other thus creating a combination of 
multiple pieces of content. 

In one embodiment, a projection 925 displays content that originates from 

15 the projector 905; a projection 935 displays content that originates from the 
projector 910; and a projection 930 displays content that originates from the 
projector 915. The projections 925, 930, and 935 are examples of content that 
are shown in an exclusive area with no overlap. A projection 940 displays a 
combination of content originating from the projector 905 and the projector 910. 

20 A projection 950 displays a combination of content originating from the projector 
905 and the projector 915. A projection 945 displays a combination of content 
originating from the projector 910 and the projector 915. A projection 960 
displays a combination of content originating from the projector 905, the projector 
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910, and the projector 915. The projections 940, 945, 950, and 960 are 
examples of content that is shown overlapping with multiple pieces of content 
thus creating a combination of multiple pieces of content. 

The foregoing descriptions of specific embodiments of the invention have 
been presented for purposes of illustration and description. The invention may 
be applied to a variety of other applications. 

They are not intended to be exhaustive or to limit the invention to the 
precise embodiments disclosed, and naturally many modifications and variations 
are possible in light of the above teaching. The embodiments were chosen and 
described in order to explain the principles of the invention and its practical 
application, to thereby enable others skilled in the art to best utilize the invention 
and various embodiments with various modifications as are suited to the 
particular use contemplated. It is intended that the scope of the invention be 
defined by the Claims appended hereto and their equivalents. 
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